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ABSTRACT 



The Florida Community College Accountability Plan: 

An Analysis of Institutional Characteristics and Success 
at Meeting State Defined Performance Measures 

State-based performance indicators for postsecondary education are rapidly becoming the 
hallmark of the 1990’s. A number of states now have some form of performance indicator 
legislation enacted and with each legislative session the number increases. This paper 
studies the reliability and validity of accountability measures and performance indicators 
established at the state-level for a system of community colleges and reviews the 
appropriateness of the measures for systemic decision making and public reporting. This 
paper serves as a challenge to the institutional research community to take an active role in 
the study of measures defined as instruments of public higher education policy. 




The Florida Community College Accountability Plan: 

An Analysis of Institutional Characteristics and Success 
at Meeting State Defined Performance Measures 

1. Introduction and Perspective 

State-based performance indicators for postsecondaiy education are rapidly becoming the 
hallmark of the 1990's. By 1993 over one-third of the states had some form of performance 
indicator legislation enacted (Bogue, Creech & Folger, 1993) and with each legislative session 
since the number has increased. Discussion at the state level has begun to shift toward funding 
the enterprise based on outcomes, effectiveness, and efficiency (Gather. Nedwek, and Neal. 1994). 
Significant attempts at operationalizing these grand concepts and weaving them into the fabric of 
planning, policy and budget development were given license in several states during the 1996 
legislative session. In the 1994 Education Commission of the States publication Charting Higher 
Education Accountability (Ruppert. 1994) a case study of ten states indicated that the adoption 
of state-level performance indicators was most often done rapidly, relied on existing data and was 
usually driven by legislative initiative. This report implied that few states have accomplished the 
analysis necessary to define measures appropriate for systemic decision making and public 
reporting. 

The Florida Community College System has had an effective system-level data collection 
effort in place for over two decades. Florida is one of the States that has moved aggressively to 
adopt state-level performance indicators. The 1994 Accountability Plan for Florida Community 
Colleges clearly established the relationship of the accountability measures, which met legislative 
requirements, with the mission and five-year master plan for the Co mmuni ty College System. The 
Accountability Plan established an oversight process and set goals for each of the accountability 
measures system-wide and for each campus. Seventeen measures encompassing five majors by 
seventeen indicators have been collected for three years and individual goals for each institution 
on each indicator established. This study was conducted to explore whether these measures are 
appropriate for systemic decision making and public reporting. 




2. Purpose 



The purpose of this paper was to study the reliability and validity of accountability 
measures established at the state-level for a system of community colleges and review the 
appropriateness of the measures for systemic decision m akin g and public reporting. 

3. Literature Review and Background 

There has been significant discussion on the development of performance indicators 
and their use in higher education. Among these extant models are: the National Association 
of College and University’s Financial Self-Assessment Workbook (1987); Performance 
Measurement Systems for Higher Education (Kidwell and Long. 1995); Strategic Indicators for 
Higher Education (Taylor, Myerson and Massy, 1993); and Measuring Up; The Promises and 
Pitfalls of Performance Indicators (Gather, Nedwek and Neal, 1994). Currently in progress is the 
NACUBO Benchmarking Project, which is focused on developing quantitative measures to set 
as a point of reference and standard for basic operations. However, most of the analysis and 
literature on the development of state-level performance indicators describes a pattern of 
implementation with little prior conceptual development and a focus on inter-institutional 
comparison (Bogue. Creech & Folger. 1993). A 1994 Education Commission of the States study 
found that performance indicator initiatives in the various states contain many of the same 
measures (Ruppert. 1994). Most of the states studied used 20 or so indicators that were 
collected by a governing board and reported in a tabular form. The indicators most commonly 
used reflected some measure of; instructional inputs; instructional process and use of 
resources; instructional outcomes; efficiency and productivity; diversity and access; 
articulation; and relation to state needs. 

In the 1987 revision of. Financial Self- Assessment: A Workbook for Colleges and 
Uni versities. (Dickmever & Hughes ) the concept of an overall institutional equation, defined in 
terms of performance indicators, was emphasized. It was strongly implied in this volume that 
there were ranges within the various indicators presented that indicated good, moderate or 
poor performance on a given indicator. It was also implied, in this major work of a standing 
NACUBO committee, that a certain equation could be inferred for an institution from a 
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combination of these indicators. It was further implied that this unique equation could 
provide an indication of institutional health, and areas of institutional strength and 
weakness. The most noticeable addition to this line of thinking was put forth by Mary Sapp 
(1994) in the AIR Professional File document. Setting a Kev Success Index Report: A How to 
Manual . Institutions are complex, and within this paradigm there are a number of possible 
equations. Further research must be done in defining the use and efficacy of performance 
indicators, particularly, if they are to be used as major vehicles in defining and enforcing state 
policy. 

Under Section 240.324 Florida Statutes (1991, the State Board of Community Colleges 
and the community colleges boards of trustees were to “develop and implement a plan to 
improve and evaluate the instructional and administrative efficiency and effectiveness of the 
State Community College System." The law specifically mandated that the accountability 
planning process address the following issues: 

a) graduation rates of Associate of Arts (AA) and Associate of Science (AS) degree- 
seeking students compared to first-time enrolled students seeking the associate 
degree: 

b) minority student enrollment and retention rates; 

c) student performance, including student performance rates on college-level academic 
skills tests, mean grade point averages for community college AA transfer students, 
and community college student performance on state licensure examinations: 

d) job placement rates of community college vocational students: and. 

e) student progress by admission status and program. 

In response to this legislative initiative, the Florida State Board of Community Colleges 
adopted an Accountability Plan in 1994, which established the relationship of accountability 
measures, which met the legislative requirements, with the mission and five-year Master Plan 
for the community college system. The Committee on Accountability and Effectiveness, a 
standing committee under the State Board of Community Colleges Program and Planning 
Committee defined these accountability measures. The 1994 Accountability Plan also provided 
a framework within which the accountability planning process would take place, established 



and oversight process, and set System goals for each of the accountability measures! In 
accordance with the legislation, each community college developed an Institutional 
Accountability Plan and established Institutional Five-Year Goals for each of the seventeen 
defined measures. Table I shows details for each of the seventeen accountability measures that 
operationally define the Accountability Plan. 

Table 1 

Definition of the Florida community college accountability measures 

• Associate in Arts Retention Measure - The percent of associate in arts degree students who 
have earned 18 credit hours, that were retained or graduated four years after the date of 
initial enrollment, (label = Retention Rate A.A.) 

• Associate in Arts Success Measure - The percent of associate in arts degree students who 
have earned at lest 18 credit hours, have graduated, were retained in good standing, or left 
in good standing four years after the date of initial enrollment. . (label = Success Rate A.A.) 

• Associate in Science Retention Measure - The percent of associate in science degree 
students who have earned 18 credit hours that were retained or graduated four years after 
the date of initial enrollment, (label = Retention Rate A.S.) 

• Associate in Science Success Measure - the percent of associate in science degree students 
who have earned at lest 18 credit hours, have graduated, were retained in good standing, or 
left in good standing four years after the date of initial enrollment. . (label = Success Rate 
A.S.) 

• Postsecondary Vocational Certificate Retention Measure - The percent of postsecondaiy 
vocational certificate program students who have earned 18 credit hours, that were 
retained or graduated four years after the date of initial enrollment, (label = Retention Rate 
P.S.V.C.) 

• Postsecondary Vocational Certificate Success Measure - The percent postsecondaiy 
vocational certificate program students who have earned at lest 18 credit hours, have 
graduated, were retained in good standing, or left in good standing four years after the date 
of initial enrollment. . (label = Success Rate P.S.V.C.) 
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Associate in Arts Transfer Student Performance - The percent of students, having 
completed their entire associate in arts degree program at a community college in which 
they initially enrolled, who after one full year at a university have a GPA at or above 2.5 on 
a 4.0 scale, (label - GPA Performance A.A. 2.5 & Above) 

Licensure Pass Rate Measure - The percentage of associate in science degree program 
students who, after completing their degree program, passed the licensure exam for their 
respective vocational program, (label = State Licensure Pass Rate) 

Placement Rate Measure - The percentage of associate in science degree program students 
who, after completing their degree program, were found in the Florida Education and 
Training Placement Information Program pool of employed and were placed in an 
occupation related to their instruction, (label = Vocational Prog ram Placement) 

College Preparatoiy Reading Performance Measure - The percentage of first time in college 
(FTIC) students who tested into and enrolled in reading preparatory courses who have 
successfully completed the program within two years, (label = College Prep Success Rate - 
Reading) 

College Preparatoiy Writing Performance Measure - The percentage of first time in college 
(FTIC) students who tested into and enrolled in writing preparatory courses whom have 
successfully completed the program within two years, (label = College Prep Success Rate - 
Writing) 

College Preparatoiy Math Performance Measure - The percentage of first time in college 
(FTIC) students who tested into and enrolled in math preparatory courses who have 
successfully completed the program within two years, (label = College Prep Success Rate - 
Math) 

College Preparatoiy Retention Measure - The percent of students who successfully 
completed a college preparatoiy program and have subsequently graduated, or who are still 
enrolled in an associate in arts degree program, four years after the date of initial 
enrollment in the A.A. degree program, (label = College Prep Retention Rate A.A.) 

College Preparatory Success Measure - The percent of students who successfully completed 
a college preparatory program and have subsequently graduated, or who are retained in 



good standing, or who have left in good standing, four years after the date of initial 
enrollment in the A. A. degree program, (label = College Prep Success Rate A.A.) 

• Associate in Arts CLAST Measure, College Preparatory Students - The percentage of 
students who successfully completed a college preparatory program, and have completed 60 
or more college credits at a specific institution, who have met the College Level Academic, 

Skills Test (CLAST) passing standards, (label = CLAST Performance College Prep) 

. Associate in Arts CLAST Measure, Non-CoUege Preparatory Students - The percentage of 
students who, were admitted as regular students, who have completed 60 or more college 
credits at a specific institution who have met the CoUege Level Academic Skills Test (CLAST) 
passing standards, (label = CLAST Performance Non-College Prep) 

• Associate in Arts CLAST Measure, All Students - The percentage of students who have 
completed 60 or more college credits at a specific institution who have met the College Level 
Academic Skills Test (CLAST) passing standards, (label = CLAST Total Performance) 

With the approval of the 1996 Accountability Report of the Florida Community College System by 
the State Board of Community Colleges three years of data on the accountability measures at 
institutional level were available for analysis. Most of the measures reflect outcomes related to 
activity at the institutions for four years prior. An analysis examining the characteristics of 
institutions successful in meeting their goals, and of the usefulness of the goals themselves, 
would most appropriately be accomplished after year five. 

4. Data Sources 

The 1996 Accountability Report of the Florida Community College System provides data on 
17 accountability measures for the 28 institutions in the Florida system. Data from each of the 
institutions for each of the measures for the three school years 1993-94, 1994-95, and 1995-96 was 
collected from this report. Information on institutional characteristics was collected from the 
system-level database maintained by the Florida Division of Community Colleges. These actual score 
measures served as dependent variables in the study together with a ratio level number representing 
progress toward goal. This second measure was created by dividing the score measure for each 
college for the three school years by the five year goal established for that measure and college. 
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Data to be used as independent variables in the study were collected from reports ‘ 
produced by the Division of Community Colleges Bureau of Research and Information Systems. 
Given that most of the accountability measures reflect activity that had occurred four years 
prior, data was collected for these years as appropriate. Institutional and program attributes 
were defined from available data that reflected measures of institutional size, program mix and 
expenditures. Those measures are detailed in Table 2. 

Table 2 

Measure of institutional attributes 

Measures of Institutional or Program Size 

• Total institutional FTE enrollment 

• Total advanced and professional FTE enrollment 

• Total postsecondary vocational FTE enrollment 

• Total adult postsecondary vocational FTE enrollment 

• Total college preparatory FTE enrollment 
Measures of Ffrogram Mix 

• Total advanced and professional FTE enrollment as a percent of Total FTE enrollment 

• Total postsecondaiy vocational FTE enrollment as a percent of Total FTE enrollment 

• Total adult postsecondary vocational FTE enrollment as a percent of Total FTE enrollment 

• Total college preparatory FTE enrollment as a percent of Total FTE enrollment 
Measures of Institutional or Program Expenditures 

• Total instructional expenditures as a percent total expenditures by institution 

• Total non-instructional expenditures as a percent total expenditures by institution 

• Advanced and professional institutional full cost per FTE 

• Postsecondary vocational institutional full cost per FTE 

• Adult postsecondary vocational institutional full cost per FTE 

• Total college preparatory institutional full cost per FTE 

• Average salary of full time instructional personnel calculated as a 2.0 semester equivalent by 
institution 
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6. Results or Conclusions 

The most notable result in phase one was the fairly wide dispersion between the 
institutions on the actual accountability measures and on progress toward goal. As can be 
seen in figures 1 through 17, eight of the accountability measures exhibited some progress 
toward goal, in the terms of system-wide mean and a decreasing dispersion, while nine did not. 
The measures showing some progress included the: associate in arts retention measure (Figure 
1) ; associate in arts success measure (Figure 2); associate in science success measure (Figure 
4); postsecondary vocational certificate retention measure (Figure 5); postsecondary vocational 
certificate success measure (Figure 6): associate in arts transfer student performance measure 
(Figure 7); college preparatory reading performance measure (Figure 10): and the college 
preparatory retention measure (Figure 13). Interestingly sLx of these are related to retention 
and success and the remaining two to academic performance. 

Phase two produced a number of interesting interactions that warrant further study in 
the future when more data is available. Examining measures related to the associate in arts 
programs higher faculty salaries, a higher percent of total expenditures spent on instruction, 
and a higher overall FTE count seemed to be related to higher retention and success. 
Interestingly, cost per FTE for the A&P program showed little differentiated effect. What was 
not readily explained was that institutions with a lower percentage of students in A &P 
programs had a lower retention rate and institutions with a higher percentage of students in A 
& P programs had lower success rate. 

Examining measures related to the associate in science progr ams , a higher overall FTE 
count and a higher percent of postsecondary vocational FTE students seemed to be related to 
higher retention and success. Interestingly, there were no other institutional characteristics 
that were visibly related to the accountability measures for the associate in science programs. 

Examining several academic performance accountability measures indicated that 
students from institutions with smaller student populations were more successful in the 
classroom at senior institutions than students from larger institutions. Institutions with a 
higher percentage of students in A & P programs and institutions with a higher percent of total 
expenditures spent on instruction evidenced higher total performance on the CLAST measure. 
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Overall, some of the effects seen in the analyses conducted for phase two make intuitive 
sense while others do not. What is clear is that the constructs defined in this state's 
accountability program for community colleges contain a rich potential mix of effects and 
interaction effects. Establishing construct validity for these potential instruments of public 
higher education policy will require the following: a sophisticated and appropriate research 
design: more discrete data on individal academic programs at the institution level; more 
discrete data on students in individual programs at the instituion level; and an appropriate 
historical framework for the data. 

7. Implications for Institutional Researchers 

The first implication for institutional researchers is that state-established 

accountability measures and performance indicators should undergo rigorous analysis in 
terms of their validity and reliability related to the constructs that they are purported to 
measure. The results of this preliminary study indicate that the institutional research 
community must take an active role in the study of measures defined as instruments of 
public higher education policy. 
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Figure 1 

Associate in Arts Retention Measure: Score Measure 
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Figure 2 



Associate in Arts Success Measure: Score Measure 
and as a Percent of Goal 
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Figure 3 



Associate in Science Retention Measure: Score Measure 
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Figure 4 



Associate in Science Success Measure: Score Measure 

and as a Percent of Goal 
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Figure 5 



Post-Secondary Vocational Certificate Retention Measure: 
Score Measure and as a Percent of Goal 
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Figure 6 



Post-Secondary Vocational Certification Success Measure: 
Score Measure and as a Percent of Goal 
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Figure 7 



Associate in Arts GPA Performance Measure: Score 
Measure and as a Percent of Goal 
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Figure 8 



Licensure Pass Rate Measure: Score Measure 
and as a Percent of Goal 
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Figure 9 

Vocational Program Placement Rate Measure: Score 
Measure and as a Percent of Goal 
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Figure 10 



College Preparatory Reading Performance Measure: 
Score Measure and as a Percent of Goal 
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Figure 11 



College Preparatory Writing Performance Measure: 
Score Measure and as a Percent of Goal 
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Figure 12 



College Preparatory Math Performance Measure: 
Score Measure and as a Percent of Goal 
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Figure 13 



College Preparatory Retention Measure: Score 
Measure and as a Percent of Goal 
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Figure 14 



College Preparatory Success Measure: Score 
Measure and as a Percent of Goal 
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Figure 15 

Associate in Arts CLAST Measure - College Preparatory 
Students: Score Measure and as a Percent of Goal 
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Figure 16 



Associate in Arts CLAST Measure - Non-College 
Preparatory Students: Score Measure 
and as a Percent of Goal 
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Figure 17 



Associate in Arts CLAST Measure - All Students: 
Score Measure and as a Percent of Goal 
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A & P FTE as a % of Total A & P FTE as a % of Total 



Figure 18 



Retention and Success Rate: Associate in Arts 
By A & P FTE as a % of Total By Group 
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Figure 19 



Retention and Success Rate: Associate in Arts 
By Instructional Expenditures as % of Total By Group 
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Figure 20 



Retention and Success Rate: Associate in Arts 
By A & P Costs Per FTE By Group 
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Figure 21 



Retention and Success Rate: Associate in Arts 
By Average Full Time Faculty Salary by Group 
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Figure 22 



Retention and Success Rate: Associate in Science 
By Total FTE by Group 
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PSV FTE as % of Total PSV FTE as % of Total 



Figure 23 



Retention and Success Rate: Associate in Science 
By PSV FTE as % of Total By Group 
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Figure 24 



Retention and Success Rate: Associate in Science 
By Instructional Expenditures as % of Total By Group 
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Figure 25 

Retention and Success Rate: Associate in Science 
By PSV Costs per FTE By Group 
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Figure 26 



Retention and Success Rate: Associate in Science 
By Average Full-Time Faculty Salary By Group 
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Figure 27 



Retention and Success Rate: Associate in Science 
By of Total FTE By Group 
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Figure 28 

Associate of Arts Transfer Student Performance by 
Average Faculty Salary and Total FTE by Group 
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Figure 29 

Retention and Success Rate: Associate in Arts by 
Performance on CLAST by Group 
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Instructional Expenditures as a % of Total A & P as a % of Total 



Figure 30 

Associate in Arts CLAST Measure 
Total A&P and Instructional Expenditures 
as a Percent of Total by Group 
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Figure 31 

Associate of Arts CLAST Measure 
? and College Preparatory Costs per FTE by Group 
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Figure 32 

Associate of Arts Retention Measure 

ANOVA 



Model Summary 
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a- Predictors: (Constant), AVGSAL, APPCT, APFC, TOTNIN, AP, TOTINS, TOTAL 


b. Dependent Variable: RRAA 
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a. Dependent Variable: RRAA 
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Figure 33 

Associate of Arts Success Measure 
ANOVA 



Model Summary 



Std Error Change Statistics 

Adjusted of the R Square Slg. F 

Model R R Square R Square Estimate Change F Change dfl df2 Change 

T_ . 426 ^ 1 182 /106 13,9509 .182 2.410 7 76 .028 

a - Predictors: (Constant), AVGSAL, APPCT, APFC, TOTNIN, AP, TOTINS, TOTAL 



ANOVA b 
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a- Predictors: (Constant), AVGSAL, APPCT, APFC, TOTNIN, AP, TOTINS, TOTAL 
b. Dependent Variable: SRAA 
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Figure 34 

Associate of Arts Success Measure 
As a Percent of the Five Year Goal 
ANOVA 



Model Summary 
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a. Predictors: (Constant), AVGSAL, APPCT, TOTNIN, APFC, AP, TOTJNS, TOTAL 
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a- Predictors: (Constant), AVGSAL, APPCT, TOTNIN, APFC, AP, TOTINS, TOTAL 




b- Dependent Variable: GSRAA 
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a OaDandant Variable: GRQAA 
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Figure 35 

Associate in Science Retention Measure 

ANOVA 



Model Summary 



Std. Error Change Statistics 

Adjusted of the R Square 

R R Square R Square Estimate Change F Change dfl <jf2 

j_ 463 a .215 .139 11.8711 .215 2.852 7 73 

a - Predictors: (Constant), AVGSAL, PSVPCT, PSVFC, TOTNIN, PSV, TOTINS, TOTAL 
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a - Predictors: (Constant). AVGSAL, PSVPCT, PSVFC, TOTNIN, PSV, TOTINS, TOTAL 
b - Dependent Variable: RRAS 
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a - Dependent Variable: RRAS 
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Figure 36 

Associate in Science Measure 
As a Percent of the Five Year Goal 
ANOVA 



Model Summary 
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a- Predictors: (Constant), AVGSAL, PSVPCT, PSVFC, TOTNIN, PSV, TOTINS, TOTAL 
b. Dependent Variable: GRRAS 
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a - Dependent Variable: GRRAS 
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Figure 37 



Licensure Pass Rate Measure 
As a Percent of the Five Year Goal 
ANOVA 



Model Summary 
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a. Predictors: (Constant), AVGSAL, PSVPCT, PSVFC, PSV, TOTNIN, TOTINS, TOTAL 












ANOVA b 














Sum of 




Mean 








Model 




Squares 


df 


Square 


F 


Sig. 




1 Regression 


6.819E-02 




7 9.741 E-03 


2.296 


,036 a 


Residual 


.297 




70 4.242E-03 








Total 


.365 




77 










a - Predictors: (Constant), AVGSAL, PSVPCT 


, PSVFC, 


PSV, TOTNIN, TOTINS, TOTAL 


b- Dependent Variable: GSLRP 
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a. Dependent Variable: GSLRP 
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Figure 38 



Postsecondary Vocational Certificate Success Measure 
As a Percent of the Five Year Goal 
ANOVA 



Model Summary 
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a. Dependent Variable: GSRP 
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Florida Community College Accountability Program Analysis 

Variables and Analysis 



Dependent Varables For 94, 95. 96 



rraa = Associate in Arts Retention Measure 

sraa = Associate in Arts Success Measure 

rras = Associate in Science Retention Measure 

sras = Associate in Science Success Measure 

rrp = Postsecondary Vocational Certificate Retention Measure 

srp = Postsecondary Vocational Certificate Success Measure 

gpa = Associate in Arts Transfer Student Performance 

slrp = Licensure Pass Rate Measure 

vpp = Placement Rate Measure 

cpsrr = College Preparatory Reading Performance Measure 
cpsrw = College Preparatory Writing Performance Measure 
cpsrm = College Preparatory Math Performance Measure 
cpraa = College Preparatory Retention Measure 
cpsaa = College Preparatory Success Measure 

clastc = Associate in Arts CLAST Measure, College Preparatory Students 

clastn = Associate in Arts CLAST Measure, Non-College Preparatory Students 

clastp = Associate in Arts CLAST Measure, All Students 

grraa = rraa as a percent of a five year goal 

gsraa = sraa as a percent of a five year goal 

grras =rras as a percent of a five year goal 

gsras = sras as a percent of a five year goal 

grrp = rrp as a percent of a five year goal 

gsrp = srp as a percent of a five year goal 

ggpa = gpa as a percent of a five year goal 

gslrp = slrp as a percent of a five year goal 

gvpp = vpp as a percent of a five year goal 

gcpsn* = cpsrr as a percent of a five year goal 

gcpsrw = cpsrw as a percent of a five year goal 

gcpsrm = cpsrm as a percent of a five year goal 

gcpaa = cpaa as a percent of a five year goal 

gcpsaa = cpsaa as a percent of a five year goal 

gclastc = clastc as a percent of a five year goal 

gclastn = clastn as a percent of a five year goal 

gclastp = clastp as a percent of a five year goal 



Independent Variables For 91. 92. 93, 94, 95, 96 

ap = Total advanced and professional FTE enrollment 
psv = Total postsecondaiy vocational FTE enrollment 
psav = Total adult postsecondaiy vocational FTE enrollment 
prep = Total college preparatory FTE enrollment 
total = Total institutional FTE enrollment 

appct = Total advanced and professional FTE enrollment as a percent of Total FTE enrollment 
psvpct = Total postsecondaiy vocational FTE enrollment as a percent of Total FTE enrollment 
psavpct = Total adult postsecondary vocational FTE enrollment as a percent of Total FTE enrollmen 
prepct = Total college preparatory FTE enrollment as a percent of Total FTE enrollment 
apfc = Advanced and professional instructional full cost per FTE 




52 



psvfc = Postsecondary vocational instructional full cost per FTE 
psavfc = Adult postsecondaiy vocational institutional full cost per FTE 
prepfc = Total college preparatory institutional full cost per FTE 

totins = Total instructional expenditures as a percent total expenditures by institution 
totnin = Total non-instructional expenditures as a percent total expenditures by institution 
avgsal = Average salary of full time instructional personnel calculated sis a 2.0 
semester equivalent by institution 



From the dependent variable set run as indpendent variables For 94. 95. 96? 

rraa 

sraa 

cpsrr 

cpsrw 

cpsrm 

Program mix = appct, psvpct, psavpct, prepct 
Program full costs = apfc, psvfc, psavfc, prepfc 
Institutional expense = totins, totnin, avgsal 

Academic measures related to academic outcomes = rraa. sraa, cpsrr, cpsrw, cpsrm 

Dependent Variables for 94 
Independent Variables = 91, 92, 93, 94 

Dependent Variables for 95 
Independent Variables = 92, 93, 94, 95 

Dependent Variables for 96 
Independent Variables = 93, 94, 95, 96 

FTE or size of institution or program = 
ap, psv, psav, prep, total 

Overall Research Questions ? 

1. Are we making progress toward the goals on the 17 accountability measures at the 
institutional level from a system perspective? 

2. At the institutional level, are scores increasing on the 17 accountability measures? 

3. What are the institutional attributes that account for the difference among institutions in 
progress toward goal? 

4. What are the institutional attributes that account for the difference among institutions on 
score meaures for the 17 accountability measures? 

Anavlsis #1 



Box plots on the 17 accountability measures for all insitutions across 94, 95, 96. 



A « •* ► 



Analysis #2 

Box plots on progress toward goal for the 17 accountability measuresfor all institutions 
across 94, 95, 96. 

Analysis #3 

Dependent variable = rraa, sraa, grraa, gsraa 

Independent variables = ap, appct, apfc, avgsal, total, totins, totnin 

Analysis #4 

Dependent variable = rras, sras, slrp, grras, gsras, gslrp 
Independent variables = psv, psvpct, psvfc, avgsal, total, totins, totnin 
Analysis #5 

Dependent variable = rrp, sras, srp, grrp, gsrp, 

Independent variables = psav, psavpct, psavfc, avgsal, total, totins, totnin 
Analysis #6 

Dependent variable = vpp, gvpp, 

Independent variables = psv, psav, psvpct, psavpct, psvfc, psavfc, avgsal, total, totins, 
totnin 

Analvsisi #7 

Dependent variable = gpa 

Independent variables = ap, appct, apfc, avgsal, total, totins, totnin, rraa, sraa, 

Analysis #8 

Dependent variable = clastn, clastp, gclastn, gclastp 

Independent variables = ap, appct, apfc, avgsal, total, totins, totnin, rraa, sraa. 

Analysis #9 

Dependent variable =cpsrr, cpsrw, cpsrm, gcpsrr, gcpsrw, gcpsrm 
Independent variables = prep, prepct, prepfc, avgsal, total, totins, totnin 
Analysis #10 

Dependent variable =cpraa, cpsaa, clastc, gcpraa, gcpsaa, gclastc 

Independent variables = ap, prep, appct, prepct, apfc, prepfc, avgsal, total, totins, totnin, 
cpsrr, cpsrw, cpsrm 
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